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PREFACE 



In the operations analysis curriculum at the United States Naval 
Postgraduate School numerous reports were presented from 1952 to 1954 
which exemplified some methods and techniques for comparing weapons, 
methods, strategies, etc,, quantitatively using a measure of effective- 
ness. These reports seemed to place little emphasis on the relative 
amount of effort or assets available to implement a final decision. 

This paper is written to emphasize the necessity of considering not 
only the amount of effort available but also the manner and times at 
which increments of effort become available. 

The writer would like to express sincere appreciation to Drs, T.E. 
Oberbeck and C.C. Torrance of the Naval Postgraduate School for their 
guidance and criticism during the preparation of this paper. Dr. Ober- 
beck spent countless hours examining the programming aspects particularly 
and provided invaluable assistance in the phrasing and wording of dif- 
ficult sections. Dr. Torrance suggested the addition of illustrative 

4 

problems to demonstrate the use of the theoretical concepts in practi- 
cal situations and helped reword obscure sections throughout. Neither 
shoxxld be held accountable for other obscure passages which undoubtedly 
remain. 
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CHAPTER I 



INTRODUCTION 

Measures of effectiveness such as exchange rates, search rates, loss 
rates, production rates, transportation rates, and other ratio criteria, 
can be used effectively to make a quantitative comparison of alternative 
methods of accomplishing a given objective. Writers of practicability 
studies and feasibility studies compare proposed weapons, strategies, de- 
vices, and methods using measures of effectiveness. Military leaders and 
civilian executives use measures of effectiveness either consciously or 
unconsciously when seeking a quantitative basis for decision. This paper 
introduces three considerations that affect the use of measures of ef- 
fectiveness and presents representative problem solutions which demon- 
strate methods of dealing with each. 

The considerations mentioned above are the basis of three types of 
problems : 

(1) Optimum Distribution of Effort Problems. 

(2) Linear Programming or Activity Analysis Problems. 

(3) Game Theory Problems. 

Each of these problems involves restrictions that may be indicated as 
follows ; 

Optimum Distribution of Effort Problem . 

A limited amount of money, manpower, materials, or other assets is 
available to accomplish a given task. Two or more "alternatives” (methods, 
devices, strategies, or weapons) are to be compared on the basis of that 
limited amount. For example, suppose an executive of a hypothetical steel 
mill faces the following situation. An urgent order is received for 
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Hi-chrome steel (a hypothetical type of steel). Furnaces number one and 
two which can produce Ki-chrome steel are shut down. Only a limited sup- 
ply of coal is stockpiled, and it is apparent that no more coal can be 
obtained before the time limit expires for the steel order. Furnace nvim- 
ber one requires relatively little coal during wann-up and reaches its 
optimum usage ratio (defined as the number of tons of steel produced per 
ton of coal consumed) soon after warm-up is completed. Furnace ntimber 
two requires more coal for warm-up and reaches its optimum usage ratio 
more slowly than number one, but has a better optimum usage ratio than 
number one. The steel executive desires to manufacture as much Hi-chrome 
steel as possible, using the available coal regardless of all other con- 
siderations, and he has the following alternatives: (1) operate number 

one alone, (2) operate number two alone, or (3) operate both simul- 
taneously. See Appendix for a problem solution of this type. 

Linear Programming Problems . 

A limited amount of some asset, say steel, is now available to ac- 
complish a given task, but the quantity of available steel may be in- 
creased by a process involving feedback of some of the steel, although 
the process is time consuming. The given task requires the maximization 
of some quantity at the end of a specified time interval subject to a 
system of inequalities. The maximization process might be static or dy- 
namic, If static, the feedback ratio is initially determined and re- 
mains constant thereafter. If dynamic, the feedback ratio is changed 
continuously or as required to produce an optimum solution. As an exam- 
ple of dynamic programming, consider a steel executive with an initial 
amount of steel on hand and an initial number of furnaces who desires to 
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maoimlze his steel stockpile at the end of a specified time interval. 

He must allocate some fraction of the available steel to building new 
furnaces, another fraction to be exchanged for the raw materials re- 
quired in making new steel, and the remaining fraction to be stockpiled. 
Any' one or two of these fractions may be zero as long as all of the steel 
is devoted to one of the three uses; and the above fractions may be 
changed continuously or as desired. Assume that the rate of increase in 
the number of furnaces is linearly dependent on the quantity of steel 
devoted to making furnaces and the rate of steel production is linearly 
dependent on the quantity of steel being exchanged for the raw materials 
and services required to make new steel. The executive must find a sys- 
tem for allocating available steel so as to maximize the amoxint of stock- 
piled steel at the end of the specified time interval. Chapter III shows 
a solution to a particular problem of this type. 

Game Theory Problem. 

The amoxmt of effect expected from a unit of effort in one of the 
above type problems depends on countermeasures employed by some opposing 
force. For example, consider a state of war to exist when the steel ex- 
ecutive in the first example above receives the order for Hi-chrome steel. 
Friendly intelligence reports show that the enemy, knowing the strategic 
value of Hi-chrome steel, is willing to expend an atomic bomb to halt as 
much steel production as possible. The funmces will be partially opera- 
ble if hit by a bomb and their usage ratios will differ as stated earlier. 
Assume that all available coal must be stored in two barges, each holding 
half of the coal. Further assume two coal storage locations for the 
barges near each furnace site such that a bomb hitting near either site 



3 









$.1 



V 




i 





will destroy a coal barge which might be at one location, but will not 
reach barges at both locations sinniltaneously. The steel executive must 
decide how to allocate the coal so as to maximize the expected steel pro- 
duction if the enemy uses an optimal strategy in deciding which factory 
to bomb. See Appendix for a problem solution of this type. 

The preceding types of problems might be encovintered by a military 
commander in the following elementary examples: 

(1) Search Problem . A downed pilot is known to be in one of two 

separated areas. Two search planes are available for a few hours only, 
and a decision must be made: (a) to send both planes for a complete 

search of one area and partial search of the other area; (b) to let both 
planes cover both entire areas by flying a leas efficient search pattern; 
or (c) to let planes split up, one searching each area. Data is available 
to show the relative efficiency of search coverage under each plan. The 
vital information needed here is the number of hours the planes will be 
available compared with the size of the areas to be searched. Other 
phases of the problem will not be considered by the methods of this paper. 

(2) Training Problem . A new type of airborne detection device has 
proved to be far more effective than previous devices in locating enemy 
submarines, and the devices are plentiful; but very few operators know 
how to use them. A friendly convoy must sail in a few days; and it is 
desired to search as much as possible of the proposed convoy route with 
this device before the convoy sails to give our anti-submarine ships a 
chance to engage all enemy submarines contacted along the route. It takes 
time for friendly ships to proceed to a given contact and engage the sub- 
marine; but once engaged the submarine will no longer be considered a 
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threat to the convoy. It Just takes a few hours to train new operators, 
but only a limited number of men can be instructed by any one operator at 
one time; and an operator cannot be searching and training other op>erators 
simultaneously. The military commander must decide how to assign the 
trained operators between searching and training other operators so as to 
have pre-searched the greatest possible part of the projjosed convoy route 
before the convoy sails. 

(3) Training Problem with Attrition. This problem includes all ele- 
ments of the above problem plus the following: The enemy knows the 

friendly military commander’s problem and tries to defeat his purpose by 
either (a) concentrating his efforts against the search planes, or (b) 
concentrating against the training facilities. 

This paper will introduce simple examples of the above types of prob- 
lems to show some techniques and reasoning which may be useful in dealing 
with the considerations given above. Chapter II deals with the first type 
problem. Chapters III and IV, with the second type, and Chapter V, very 
briefly with the third type of problem. The second and third types are 
logical extensions of the first type, and the third type may be an exten- 
sion of the second type in many instances. 
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CHAPTER II 



OPTIMUM DISTRIBUTION OF EFFORT 

Dr. Bernard Koopman^^^ proposed a graphical method and an analyti — 
cal method of finding the optimum distribution of effort under certain 
conditions when a limited amount of effort is available for the perfor- 
mance of two related tasks. It wovild appear that the graphical method , 
is sufficient to solve problems under the assumptions given below; but 
it is believed that a brief examination of some representative analyti- 
cal solutions will help to establish a better mental picture of real-life 
problems and even enable the reader to surmise a near-optinmm solution 
vdien time does not permit a thorough study. 

The following assumptions hold throughout this chapter: (1) effort 

and effect can be expressed numerically, i.e., a quantitative basis for 
decision is plausible; (2) effects from two or more alternatives (defined 
here as methods, weapons, devices, or strategies) are additive; and 
(3) the effect produced by a given effort depends only on the amount of 
that effort expended and the alternative to which the effort is supplied; 
i.e., for each alternative there is a function fj^(x) defined as a return 
function such that fi(x^) is the effect of units of effort. By defini- 
tion, a .joint return function E(xj^, X2) is the sum of two or more return 
functions : i.e., E(xj^, X2) = fj^(x^)-f-f2(x2) , where x^-h X2 = c, and c is 
the total effort available. 

The following procedure applies when finding an optimum distribution 
of effort between two alternatives by graphical methods. (Reference 4 des- 
cribes a graphical method for dealing with three alternatives in two di- 
mensions. The extension of the method of this chapter to the case of 
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three alternatives will be evident from a consideration of the techniques 
of reference 0 . 

(1) Construct a horizontal line segment of length c * X 2 « 

(2) At each end of this line erect a vertical axis. Label the left 
axis the fj^(x) axis and the right one the f2(5^) axis. 

(3) Since any point on the horizontal line segment divides it into 

two smaller segments whose svun is c, let these smaller segments represent 
values for x^ and Then x^-|-X 2 = c. Call the left segment x^ and the 

right segment x^* Consider only points on the horizontal segment which 
are between the vertical axes since negative values of x are not defined. 

(4) KLot two points directly above each point on the horizontal line 
for which values of the f^(x) are known, one point to represent fj^(x]^) 
and the other to represent f 2 (x 2 ). Presumably, the return functions are 
not known implicitly. 

(5) Join the above points by smooth curves representing f^(x) and 
f 2 (x) and then plot a third curve, E(x^,x 2 ), by summing the ordinates of 
the other two curves. Figure 3» page 10, shows several representative 
plots for the particular return functions given there, and these plots 
will be discussed later. A maximum point on the curve of E(xj^, X 2 ) indi- 
cates the maximum effect which may be achieved from an amount of effort, 
c, by using the two given alternatives under the assumptions given at the 
start of this chapter. 

Since we seldom expect to find return functions which satisfy the 
third basic assumption, it is convenient to define a conditional return 
function . amount of additional effect obtainable from 

X 2 units of effort applied to the second alternative after x^ units of ef- 
fort have produced an effect Trom the first alternative. If this 
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conditional return function Is substituted for steps of the 

above paragraph, a graphical solution showing the maximum effect possible 
may be obtained even though the original return functions were not additive, 
(if * additional analysis is required, 

but such an analysis is not desirable here). 

For his analytical solution Dr, Koopman^^^ chose functions which can 
be used to approximate typical behaviors for the return fiinctions by vary- 
ing the values of the constants involved as shown in Table I and Figures 1 
and 2, (Please fold out page 10 for the remainder of this discussion). 

His reasons for choosing these functions were given as follows: 

(1) they are extremely simple and amenable to mathematical manipula- 
tion; 

(2) they are immediate generalizations of formulas valid in actual 
cases; and 

(3) they correspond to simple quantitative ideas; i,e,, they can be 
derived from simple concepts of the way in which effort produces effect. 

To get an optimum solution using two of these functions, we may set the 
first and second derivatives with respect to x of the joint return func- 
tion equal to zero and solve for a maximum point by elementary calculus, 
checking to see if the values of the joint return function at the end points 
of the horizontal segment exceed any internal maxima. 

By examining typical plots of these functions such as are shown in 
Figvires 1, 2 and 3, we may classify the functions in one of the following 
categories : 

(l) Type v^ich will show an effect proportional to the effort expended 
until saturation effects occur as in Figure l(a) and 2(a); 
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(2) Type which will require either most of the available effort or 
else none at all (see Figure 1(b); 

( 3 ) Type which will require at least an amount of effort sufficient 
to produce a near-saturation effect or else none at all (see Figure 2(b) ; 
and ( 4 ) Type which should always be used (but to a relatively small ex- 
tent if type (2) or ( 3 ) is also employed. See Figures l(c) and 2(c). 

A thoi*ough study of the possible pairwise combinations of the fimc- 
tions given in Table I should bo of great help to the operations analyst. 
The military commander, who must make snap decisions in combat involving 
distribution of effort, might find that an understanding of the basic 
concepts given above is invaluable. 
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CHAPTER III 



DYNAMIC LINEAR PROGRAMMING, EXAMPLE I 

The preceding problem becomes more general if the limited assets 
available vary with time and with the manner in which we have expended 
previously held assets and if we desire to maximize a total effect at the 
end of a specified time. This new problem is a programming or activity 
analysis problem. An attempt to discuss such problems in general would 
be presumptuous here; but a simple type of dynamic linear programming 
problem will be introduced in this chapter and then expanded in the fol- 
lowing chapter to present some methodology and, it is hoped, some concepts 
vdiich will be useful in dealing with measures of effectiveness. The fol- 
lowing problem is identical mathematically with that of Dr. Isaacs^^^, 
which is discussed in the next chapter. 

A sailing ship is in an ocean bounded by infinite stretches of land 
to the west and south (see Figure 4) • The winds over this ocean are al- 
ways westerly. Wind force varies with position but not with time, and 
the force at any given spot of the ocean is known. The ship cannot sail 
closer than 90 degrees into the wind. 

The captain of this ship is ordered to travel as far north from his 
present position as possible by the end of a specified period. Since the 
wind provides the only power for propulsion, the captain must plan his 
voyage carefully to take advantage of the most favorable winds. The more 
he travels east, the stronger the winds and thus the faster he may travel; 
but an easterly component of his velocity reduces the northerly component. 

The captain, being something of a mathematician as well as being a 
good sailor, finds that he can express the speed he is able to make on a 
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given heading by using the following mathematical expressions: 

Lot X = number of miles east of the land to the west, 
y - number of miles north of the land to the south, 

X = east-west component of velocity. 
f = north-south component of velocity, 

H = instantaneous heading of the ship, (O < H < 180) 

since the ship cannot head closer than 90° into the wind, 

C = instantaneous true course of the ship, (Unfortunately, 
there is very little correlation between C and H in some 
cases) . 

Tq ■ specified time in which the captain must maximize y. 

T = problem time remaining at time t, 

h = a nxunber representing the sailing capabilities of the ship. 
It is adjustable within certain limits which are dependent 
on heading and position as follows: 







VI 

VI 

O 


1 80 -H 


(1) 




and 




fIdO 


(2) 






. 


H 


(3) 


Then, 




X - 


130 ^ 


and 




y “ 






or, 




y" 


130 ^ 


(4) 



Due to shoaling conditions, x > 1. 

The ocean may be divided into two regions, I and II, as shown in 
Figure 4» by the line: y = x (6) 
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In region I, 
In region II, 
and 



0 < h ^ /SO - H 
0 < h ^ 180 - H 
h 



^ f 180. 



( 1 ) 

( 1 ) 

( 2 ) 



We notice that a line in region II drawn through the origin, (0,0), 
with a slope, m, will divide the ocean into two parts such that 

0 ^ h for all positions north of this line. (7) 



m 



We further note that C - tan“^ i or letting c ■ (c is the slope 
of the ship’s velocity vector) C ^ tcin C , 



then c 



= =2lzJL 



X H 

im y 



H 



and also 
or 



cH = 9h - H 



H = 



9h 



h = !)• H 



C-h 1 

and 

(4) may be written y = — y 

If, momentarily, we require that h + H 

180 



y = -£lL 
180 



= 180 



then H 'h 



H 



c + 10 



and 



= 180 
f 

1620 
H = c+ 10 

1620 



c - 



H 



- 10 



Also, from (ll) and (13) 

1620 

h -h = 180 

c-f-10 

h = 180 ('l - 



c + lO 



h = 180 



c+ 1 
c-hlO 



( 8 ) 



(9) 

( 10 ) 

( 11 ) 



(13) 

(14) 



(15) 
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leo - loh 




or 



h - 180 



and from (10), (11), and (12) 




( 16 ) 



From (l), we see that H * 0 ^ x - 0 

and thus, when we start from any point Po(xq, y^), x(t) = xo 
for all t as long as H = 0, and c « co 

From ( 4 ) we see that the maximum value obtainable for is y = 9y 
when H = 0 and h = 180. 

Since these conditions may be satisfied at all positions in region I, wo 
should* choose H = 0 and h ■ 180 as long as the ship remains in region I. 
This gives: y = yoc*^^ (1 ^ y ^ x) (17) 

In region II, when c = <=o (and H = 0) , y = y = ^ y (18) 

If we let h be as large as possible to maximize f, wo have: 



Going back to (18), we see that the problem here is to make 
h = h(t) as large as possible over a given time interval, T^, in which we 
seek to reach the largest possible terminal value of y, remembering that 
it might be necessary to let h(t) be less than a maximum at some times in 
order that it might be higher "on the average” over the given time inter- 
val; i.e., we must find: 

■*^his can be proved rather simply, and the work is omitted here. 
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(19) 
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(10) & (15) 



y = 



H(t), h(t) 
max 

H(t), h(t) 




° y dt 

180 



po gh -_H . 

Jo 



(4) 



Let us solve for c when (ll) is true and h is equal to its maximuin 



allowable value in region II: 



c-f- 1 X 

h = 180 = - 180 

C+- 10 y 



(2) & (15) 



cy + y = cx + lOx 

lOx - y 

c = *— 



in II when h + H ■ 180 



( 20 ) 

( 6 ) 



y - X 

SuppxDse we pick an initial position on the line y = x 
and choose the maximum allowable value of h for that point. 

Let Po(xo, yo) - (10, 10) 

from (2), ^ ^ 

and from (20 ) , c * oo 

After travelling even a minute distance from Pq(xq, Jo) » v 

since x y as soon as the ship leaves (10, 10) with c = oo ; and we 
must pick a new value for h, % picking a value for h at Pq slightly 
less than its allowable value, we may proceed a finite time before being 
forced to change h, 

Let_ 

then H = 20 (assuming (ll)) 



ho = 160 



C = i«0 . 10 = 71 
H 



from (14) 



cH 



180 



y = 



= 7.89 
cH 



180 



y = 7.89 y 



from (10) 
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y = yo « 

cH 



7.89t 



cH 

or in general when is constant, y - Yq ^ 180 



( 21 ) 



and y _ = c(x - x^) (22) 

From (ll) and (15)» a value for h determines c. 

The limiting value of y for which wo shall be allowed to use this con- 
stant slope c when h = 160 will be determined by the intersection of (22) 



with a line through the origin having a slope, m, determined by 

180 



0 < h < 



m 



In this case, h = 160 and m ■ = § 

160 8 

For a line through the origin, 
x = iv 



ra 



and 
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X = 



9 y 



From (22) with Po(l0,10) and 

y - 10 = 7l(x - 10) 

^*y 4.200^8 

7r+7i 9 

9y -f 6300 = 568y 
y = 11.27 

From (21) , 



(7) 



(23) 



11.27 = lOe'^-^^^l 

t^ = .01515 when the value of h must be reduced, 
Reducing h in increments of 10°, wo arrive at the following table; 
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Po(^o*yo) 


c 


Hi 


hi 


cHi 

180 


m 


ti- time on leg 
of voyage with 
const, hi 


(10, 10) 


71 


20 


160 


7.89 


9/8 


,01515 


(10,01, 11,27) 


30.5 


40 


140 


6,77 


9/7 


,0202 


(10,03, 12,90) 


17 


60 


120 


5.67 


3/2 


,0290 


(10,13, 15.20) 


10.2 


80 


100 


4.55 


1%8 


,0476 


(10,50, 18,90) 


6,2 


100 


80 


3.44 


2,25 


,0972 


(11,70, 26,40) 


3.5 


120 


60 


2.33 


3.0 


.5150 


(29.20, 87.60) 


3.16 


123 


57 


2,16 


3.16 


oo 


When c = m. 


the two 


lines 


(mentioned on 


the preceding page) are paral- 



lei, and we maintain h = 57 \intil T « 0. For any other Pq on the line 
X = y a similar table to that above may be readily constructed since the 
left column will be made up of simple multiples of the above table and all 
other entries will be exactly the same as those above. The first column is 
given for two other initial points as follows: 



(1.0, i,o) 


MxcuZfll 
(100, lOO) 


(1.001, 1.127) 


(100.1, 112.7) 


(1.003, 1.290) 


(100.3, 129.0) 


(1.013, 1.520) 


(101.3, 152.0) 


(1.050, 1.890) 


(105.0, 189.0) 


(1.170, 2,640) 


(117.0, 264.0) 


(2,920, 8.760) 


(292.0, 876.0) 



The important point to note is that the time on each leg for the above 
points is the same as that shown in the original table. 

We may predict the result of repeating this procedure by taking pro- 
gressively smaller increments between successive values of h used in the 
table, and our solution is: 
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(24) 



and our equations for h and H are: 



H = 



1620 . 
c + 10 * 



h ■ 



c+1 
c+- 10 



180 



(13) & (15) 



Define a set Ila of points from region II such that (x ;< y ^iflOx) 
for all points in Ila and such that this relation will hold for no point 
of II which is not in Ila. The above solution is the optimum solution for 
H and h for all values of x and y in Ila for all T« The optimum track for 
a ship which is initially at in Ila may be obtained by solving the 

following differential eqxuition: 



° S V (""o <yo^^ ^o) 



(25) 



(lOx - y) dx -f- (x - y) dy = 0 is of the form: 

M dx -f- N dy = 0 and the integrating factor is : 



= 



. 1 



t yN 



lOx^ - xy + xy - y^ lOx^ ~ y^ 



ft" • /i^'- ^ 



— / y * 1 ^ 10x‘- y^ 2 /Ife /lOx - y |^( /lOx f 



X — V 

lQx« - y^ 



y 

jA N - Mdxj = R(y) ■ 0 

Solution of %)■ Is : 

i IndOx* - y‘) - In = i ‘ > 

' - ^ In ~ yp 

/ 2 iib /lOxo t y 
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Equations (l) thrp\igh ( 26 ) ai^ shovm in a more general form in Figure 5 * 
Solutions for other regions of the ocean will be covered in the next 
chapter. 
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CHAPTER IV 



DYNAMIC LINEAR PROGRAMMING, EXAMPLE II 

Dr. Isaacs Introduced the mathematical model for the preceding prob- 
lem in a working paper entitled "A Problem in Programming Steel Production 
and its Solution by Differential Game Theory”^ The following sections 
represent this writer*s commentary and conclusions drawn from a study of 
Dr. Isaacs* ideas. 

Part I, The Problem 

The problem may be stated as follows: 

Given : 

X]^(t) = the number of extant steel mills at time t. 

X2(t) = quantity of steel (or capital) available for sale or use at time t 
(includes all unobligated capital but not stockpiled steel). 

T = a specified time interval after which the problem or game is to termi- 
nate. Henceforth, to distinguish the two time variables, T will be 
referred to as problem time , and t will be called real time when the 
possibility of confusion exists. Note that T decreases as t increases. 
= the ratio or percentage of X2 allocated to making new steel mills at 
time t. 0]^ X2 is the amount so allocated. 

02 - the ratio or percentage of X2 devoted to making more steel. 02^2 
the amount so allocated. 

1 - (01+02) “ the ratio or percentage of X2 to be stockpiled at time t. 

^ - (0]^i- 02^ ^ the amount so allocated. 

Problem ; 

To find values for 0 ]^(x^^,X 2,T) and 02 (xj^,X 2,T) that will maximize X2 
when T = 0. 
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The correspondence between the notation of this chapter and Chapter III 



may be indicated as follows: 




^2 " 180 



b]_ = bi 



X 2 = y 



ai = ai 



T - T 




^2 “ ^2 



t = t 



Assumptions : 

(l) is a monotonically increasing value such that its rate of in- 
crease is directly proportional to the amount of steel devoted to making 
new steel mills. If a-j^ is the constant of proportionality: 



In a generalized problem of course 0 ■ 0 -j^(x^,X 2,T) and 02 = 02 (x]^,X 2»T) ; 
however, we shall see that, in this example, 0^ and 02 remain constant 
over certain sub-regions. 

(2) the rate of increase or decrease of capital (or steel on hand) is 



of decrease due to expenditures for making new steel mills, r2 is the rate 
of decrease due to expenditures for making new steel, and r^ is the gross 
rate of increase due to allocating 02^2 capital to make new steel. In- 
creasing rates are positive and decreasing rates are negative. 

a. r^ is linearly dependent at any time t on the amount of capital 

devoted, at the same time t, to making new steel mills vdth a proportionality 
constant of unity: r^ = -( 0 ^X 2 ) 

b. T 2 is linearly dependent on the amount of available capital de- 

voted, at the same time t, to making new steel with a proportionality con- 
stant of uuity: r 2 = - ( 02 X 2 ). 




( 1 ) 
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c. is linearly dependent on the amount of available capital 
devoted, at the same time t, to making new steel with a proportionality 
constant of a 2 t r^ = *f- b . 2 { 02 ^ 2 ^* 

The problem requires that the value of steel output exceed the equivalent 
steel value of inputs required to make the steel. 

Therefore, ^ - (02^2) *f“ a2(02X2) 

or ^2 - ^2 * 

(3) Problem time T remaining at any real time t is eqvial to the ini- 
tial problem time allowed minus the real time t since the problem started: 

T = To - t 




(4) Capital once allocated to one of the three basic uses cannot later 
be converted to other uses (note 1, page 3» of Dr. Isaacs^ paper). We can- 
not allocate more than 100 % of our available capital: 

ai> 0 ; 01 > 0 ; 02 ^ 0 ; 1 -( 0 i+ 02 ) >0 or 0i + 02 

(3) 

(5) must be eqiial to or less than bj^xi, (the product of the number 
of completed and fractions of completed steel mills Xi(t) and the maximum 
rate b^^ of making steel per steel mill) . b^ is a constant and therefore 
independent of the number of steel mills in operation, independent of time, 
and independent of the allocation of funds: 




a^, a 2 , and b^ are known, invariant qxiantities. 

From assumption (3), T = Tq - t, we see that vdien an amount of time 
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elapses equal to Tq, the original time interval given in which we were to 
maximize X2» then T = 0 and our problem ends. Consider a three dimensional 
Euclidean space, £ , with axes x^, X2» and T as shown in Figure 6, pot 3d). 
If we are given initial values X2» and (label this point P^j(x]^,X2,T^) 
and are told to invest and reinvest our capital so as to maximize the total 
steel inventory at the moment when T e 0 (or equivalently, after Tq units 
of time have elapsed from problem starting time), we can consider our- 
selves as guiding a point in £ starting at Pq(x^,X 2,T^) by picking opti- 
mum values for 0]^ and 02 subject to the restrictions that 0]^ ^ 0. 

01 -f- 02 ^ 1» and ^ > 02 ^ 0 as given in the assumptions previously 

2 2 

listed. A combination of 0^ and 02 is here defined as a strategy (02^,02)* 
and we shall denote an optimal strategy by Isaacs calls the 

vector sum of X]^,^, and f for given values of 0^^ and 02 a velocity vector 
and calls the plane where T = 0 the terminal or capture surface S, After 
considering all possible strategies subject to the above restrictions, we 
must pick an optimum strategy for any point (x^^,X2, T) vdiich gives us the 
maximum value of X2 when our moving point (having passed through (x 2^,X2,T)) 
hits the capture surface, S. This value of X2 is defined as the payoff, 
V(x^,X 2,T). Repeating this procedure for every such point in £ is not 
only impossible but likewise unnecessary. Under the strong assumptions 
given for this particvilar problem, it is possible to divide S into a 
finite number of well-defined sub-regions such that the optimal strategy 
determined for a point in any one of the sub-regions will also be an op- 
timal strategy for any other point in that sub-region. Dr. Isaacs proceeds 
to show how to determine the boundaries of these sub-regions, the strate- 
gies applicable for each, and the shift in strategies required as our 
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moving point leaves one sub— region and enters another sub-region enroute 
to the capture surface. 

In order to simplify the discussion, Dr. Isaacs’ notation vdll be 
changed somewhat for the remainder of this paper as follows: 

Let indicate that the payoff is a function of and T. 

Let V(P;0^^2) indicate the payoff that will be obtained by starting 



from the point P(x^,X 2 ,T) and proceeding according to the strategy » 

idiere of course, 0^ = 0 ^(x^,X 2 ,T) and 02 

Let V(P;0£*,02*) indicate the payoff that will be obtained by start- 
ing at P and proceeding according to an optimal strategy (0j^ ,02 ) . 

Evidently, V(P;0^,02) ^ V(P;0^*,02*) ^ the equality holding only when 
(01,02) is optimal. We see that a strategy (0-j^,02) must uniquely determine 
a velocity vector for every point of £. . This fact immediately leads to 
the statement that a given strategy and a given initial point will xmiquely 
determine all subsequent positions for our moving point. 

bn 

From assumption (5)» 02 ^ ^ ■ = SJ and from assumption iU) , 02 



a 



2X2 X2 



Here we see two upper bounds on 02 and note that the two are equivalent 

where ^ ^ and that for .or Xo>»^ x^, assumption (5) gives 

^2 ^1 ^2 ^1 »2 ^ 



the least upper boxind; and for assumption (4) 

^2 ^ ^2 i 

gives the least upper boxmd. 



Since we are not really interested in any upper bound which is larger 
than the least upper bound, we may construct a plane, p>' containing the T 

axis and intersecting the plane T = 0 in the line ^ and note that 

b^ ^ 

02 ^ — — for X 2 values above this plane. "This portion of £ is labeled 

^ 2^2 
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I in Figure 6, Likewise, 02 ^ 1 X 2 values below the given plane, and 
this portion of S labeled II. 

If we plot the locus of possible canbinations for 0^^ and 02 under as- 
sumptions (a) and (5) for regions I and II, we have Figure 7. In region I 
we may choose any combination (0^^, ^ 2 ^ contained in the hatched portion of 
Figure 7a; and in region II we may choose any combination (0]^,02) contained 
in the hatched p>ortion of Figure 7b. 

Dr. Isaacs remarks that at each point of 6 » we have at our disposal 
a choice of velocity vectors whose totality comprise a pyramid, the base 
being triangular in I and trapezoidal in II, the two merging continuously 
as we cross the plane, P’, and he states that we should verify that none 
of the velocity pyramids ever degenerates into a figure of fewer dimensions. 
This writer believes that these statements mean we should verify that the 
equations (l), ^2), and (3) involving 0]^ and 02 do not make such restric- 
tive conditions on the 0]_ and 02 that one of the 0j is determined as soon 
as the other is specified. This may be tested by examining the determi- 
nant of coefficients of the "variables" 0 ^,.' 02 :, and 1; 





d)01 -f-(l)02 




- (1)1 = 0 


(3) 




(a^X2)0i-f (0)02 




+ (0)1 - % 


(1) 




—(3^2)01+ X2<a-1)02 


-H (0)1 = X2 


(2) 


1 


1 -1 








(a^X2) 


0 0 




= - x^ a^(a2 - 1) 




-X2 


X2(a2 — 1) 0 








If this quantity is zero, there must 


be a redundancy; but since we 


can see 



that it never vanishes, we are assured that 02 dependent on 

each other. 
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As previously mentioned, our strategies can be resolved into five 
basic (not pure) strategies. Our problem has been somewhat simplified 
since we do not have to work out a solution for eveiry point in S can 



we must examine the nat\ire of any surfaces by which we might further divide 



Because of the simple linear form of the kinetic equations and thei 
given restrictions, we may phrase a theorem: If more than one optimal 

strategy will lead to a value V at the plane T = 0 and these routes are 
representable by routes which diverge after passing through a point, P, 
all such routes may be confined to one continuous, smooth surface defined 
by the equation V(P;0]^ ,02 ) " const. This surface will intersect the 
plane T = 0 in a half-line such that x-j^ > 0 and X 2 = V(P;0^*,02*) ■ const. 

If we accept the preceding theorem for every point in £ , we see that 
the solution to the programming problem consists of a family of surfaces 
filling ^ without intersecting, each surface being the locus of points 
where V(P;0j^*,02*) * const. The velocity vectors vriiich describe the path 
of a point governed by an optimal strategy are necessarily tangent to the 
surface containing the moving point at all times; and no velocity vector 
can make an angle of less than 90 degrees with the normal to the surface 
at any point, > 

An important part of the concept that the payoff is a function of x^, 
X 2 , and T only is the idea that the payoff is independent of real time t 
but dependent on the problem time T remaining in which to maximize xu. 



resolve £, into a finite number of sub-regions and find which strategy is 
optimal in each. So far we have divided S into two regions I and II, Now 



^ into smaller sub-regions. 




^ t/ d Xt ^ $ V ol - 9^ cl ~T 
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* 




and X2) -f- 



^1 3 X2 -“ Vij. = 0 



(4) 



letting £ V'x, 



9^2 



E l/x, ; 



31/ 

dT 



I 



¥• 

since X,= ; i.^-- Xi.\_<^z(qi-i]-< 1)] ■^T-'-l 



In this example we have five basic strategies represented by the ver- 
tices in Figures 7a and 7b, and those vertices are labeled accordingly. 

Dr, Isaacs proves that the optimal strategy at any point of must be one 
of these basic strategies. Firom eqxiations (l) and (2) we may write equa- 



Let the quantity in braces in equation (5) be represented by m^^ where 
the subscript indicates which vertex of Figure 7 represents the strategy 
being employed. To arrive at the surface V(P;0j^*, 0^) “ const., we start 
from the plane T = 0 since we know that any such surface must intersect 

f 

T = 0 in a horizontal line. By examining the max^(mi) for regions of 
analogous to those described for two dimensions in the preceding chapter, 
we may decide on an optimal strategy for each region as follows; 

(1) Pick an initial point X2 = S2 



T s 0 



(2) Find the maxj^(m^) for this point, 

(3) Let 'C = - t (thus reversing real time mathematically) and let 






) dT 



~ /fj S f C . 



o 

Find Vx, 



Vx, , 



O 










o o 

j and T at this point. 
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(4) Find the solution to the differential eqioations found in step (3). 

(5) Inspect this solution for the smallest value of C at vdiich any of 
the following occurs : 

a* Another supercedes the m found to be max at the initial point 

b. The solution cresses the boundaries where = 1 or x^ = 0. 

c. The solution cresses a boundary similar to that given for the 
problem in the preceding chapter where the strategy is known to change. 

If b. occurs, we tenninate the path. If a. or c. occurs, we take a new 
initial point vrtiere this happens and repeat the above steps. Dr. Isaacs 
proves that Vx,. and V,p are continuous at transition surfaces for this 

problem. He also performed the above steps for a generalized problem and 
obtained a general solution. His results indicate that the results given 
in the preceding chapter were correct as far as they went; but in the 
general case additional breakdowns of the given sub-regions are required; 
and, of course, additional solutions are required for each additional sub- 
region. Since the methodology should be clear from the above brief des- 
cription, no attempt will be made to examine Dr. Isaacs’ solutions for all 
the sub- regions. 

Paidi II. The Model. 

A mathematical model can be a useful tool >^en one is seeking a quanti- 
tative basis for decision; but we must recognize wher^ our model falls short 
of a real situation. The methods used in finding a solution to the mathe- 
matical model may introduce additional arrears into our results; and, con- 
versely, very precise mathematical solutions are not necessarily required 
for fairly crude models. Let us examine the mathematical model from the 
#Dr. Isaacs uses the boundary x^ = 0 vice = 1. 
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preceding problem in three respects: (l) the nature of some of the con- 
stants employed; (2) the form of the kinetic equations; and (3) the type 
of solution employed. 

The linear programming approach is more suitable for a stable situation 
than for a dynamic one. We assumed that the rate of increase of new steel 
mills was linearly proportional to the amount devoted to making new mills 

J 

with a proportionality constant of a^. We assvimed that the rate of making 
new steel was linearly proportional to the amoimt devoted to making new 
steel with a constant of a2« We assumed that the maximum rate of making 
steel per steel mill was b^. Suppose we examine these constants. The con- 
stants a^^ and a^ will be quite different when labor and raw materials ara 
plentiful than when most skilled labor and steel-making raw materials are 
in short supply, as they must become as steel production increases. The 
constant a2 will also depend to a large extent on the capacity level at 
which the plants are operating, and is thus hai*d to determine since capacity 
level is always changing. The constants a2 and b^ depend on the impetus be- 
hind the movement to increase production and also on the overall production 
effort since transportation facilities, skilled labor, and other factors 
become bottlenecks. The constants which might be derived from an exhaus- 
tive study of past operating records would be, therefore, a very crude ap- 
proximation for projected use in a dynamic programming problem. 

The kinetic equations used in these programming examples are identical, 

except for notation, with those used by Bellman^ in a very similar prob- 

( 2 ) 

lem. In another problem by Bellman' in which the steel and machine tool 
industries were assumed interdependent with no capacity restraints, the 
eqviations are more complicated. The usual assumptions of linearity were 
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maintained, and the solution again results from a set of homogeneous dif- 
ferential equations. 

Dr. Isaacs used a differential game theory solution to the problem in 
the preceding chapter. A solution using differential equations instead of 
difference equations was introduced in this paper since it is felt that dif- 
ferential equations provide a better notion of behavior and are more readily 
solved by non-mechanical methods, than are difference equations. In solving 
a problem, the difference equations might be preferable for several reasons: 
(l) they are amenable to digital computer operations; (2) they permit the 
use of discrete decision times and the use of time lags for steel alloca- 
tions to produce results; and (3) they provide for increasing the number of 
steel mills in finite steps rather than in a continuous manner. Since 
steel mills are such large units and since there will always be relatively 
few of them, even at the peak of the national economy, the improvement is 
obvious. A third type of solution would be the standard perturbation tech- 
nique leading to a Lagrange multiplier formulation. 

Another outstanding diffic\ilty with the model we have used is that it 
is deterministic instead of probabilistic; and yet in steel production we 
must have inventory control and thus probabilistic dispersion; we must have 
a safety allowance which increases as our level of operations increases and 
as the penalty factor for depletion becomes higher. The same consideration 
applies in other problems and should not be ignored. 

Most of the above remarks about mathematical models have been directed 
at the preceding example, but this does not constitute a criticism of that 
example. It merely emphasizes some ground rules >diich apply when we are 
using the model. Purtheraore, we are not really interested in steel 
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production at all in this paper. We are interested in an application of 
dynamic linear programming and the difficulties and limitations associated 
with it. The specific difficulties mentioned have their counterparts in 
other dynamic linear programming problems. 
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CHAPTER V 



GAME THEORY 



As the problem becomes still more general, vre must consider the effects 
of possible counteractions or countermeasures by opposing forces: we look 
for minimax strategies and plan in terms of game theory. Here, we do not 
try to get a numerical answer to a problem; but we hope to get an Insight 
into the nature of the general problem and to learn how to disregard poor 
strategies and to pick some combination of strategies that will put us rea- 
sonably "close” to a minimax solution. A classical example is the Hotspot 

( 9 ) 

game by Dr. Tompkins , which is suramaidzed below. 

Consider two opposing forces made up of like vessels. Blue and Orange. 
Each is subject to damage from opposing ships and also from chance causes 
such as navigation hazards and mines, but only when in a certain area called 
Hotspot. The action proceeds in a sequence of discrete moves of indefinite 
extent. Initially, Blue has m^^ units and Orange has units; and at the 
beginning of the k-th move EQ.ue has mj^ and Orange has p ^ units, where these 
numbers are determined by the results of the preceding action. The battle 
is for control of Hotspot, and strategic value is assigned in terms of gain 
or loss to Blue as follows : if Blue remains in Hotspot and Orange with- 

draws, Blue gains an amo\int A strategically; if Blue withdraws and Orange 
remains. Blue loses an amount B strategically. If both withdraw. Bluets 
strategic situation neither gains nor loses value. Each move consists of 
each contestant assigning a number of his units to fight at Hotspot. This 
number may be zero or any portion of his available forces. For the kth move, 
Blue must assign a number a^ of units to action, where is an integer with 
0 ^ — "He* % being the total force available; and Orange must assign a 
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number oCj^ of units to action, where c< is an integer with 0 
The action terminates if either a^^ or oC or both are zero. If this happens 
for some k (as it must sooner or later because of losses), then this is the 
last move and Blue, Orange, or both will have withdrawn with the strategic 
consequences listed above. Intelligence concerning forces available and 
evaluations assigned is perfect; intelligence concerning plans is zero. 

That is, before assigning forces for the kth move both Blue and Orange know 
both the numbers mj^ and and the constants A and B; and they also know 
loss probabilities and some other constants listed below. At the beginning 
of a move the loss can be predicted only probabilistically. That is, there 
is a known function P(p,TT j ^ defined for all pairs of non-negative 

integers r , p and for all non-negative integral values p and ir not ex- 
ceeding r and p respectively. Naturally, the sum of all values of P is 
one. P is the joint probability of p losses to Blue and rr losses to Orange 
if Blue commits r of his forces and Orange commits p of his forces to ac- 
tion in Hotspot, In addition to the strategic value of Hotspot, Blue loses 
one unit for each of his units lost in battle and gains cr units for each 
unit lost by Orange, Orange knows the values assigned, and his ambition is 
to oppose as strongly as possible Bluets attempt to gain in terms of these 
values. 

f 

A and B are part of the evaluation of the problem by Blue and Orange; 
they give not only a statement of the appropriate effect desired, but a 
statement of how greatly the effect is desired. Bluets plan will be one 
which assures least loss from Orange’s actions: Blue considers every possi- 
ble plan of action, considers Orange’s best reply to each plan, and then se- 
lects a plan which maximizes Blue’s expectation against Orange’s best reply. 
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Blue may assume at the time of the firat move an expected gain or loss from 
the action; and that expectancy constitutes the strategic or the military 
value of his position at that time. 

The problem of computing a value fxinction is to assign a value V(m,j4 ) 
to Bluets expected net gain if Blue has m units and Oi^nge has p vinits, and 
if each moves as well as possible. Dr. Tompkins computes a table of values 
for V for a simple case to show his methodology, but no attempt will be 
made to stmimarize that part of his results here. The important feature of 
the table that is of interest here is that any entry in the table may be 
computed from entries which precede it; and thus, the table may be con- 
structed progressively from one basic entry if values are given for A, ^ 
and other conditions are as previously stated. Dr. Tompkins preves the 
existence of the Evaluation Function; V(m, p ). 

The Hotspot game was introduced here to show a method for arriving at a 
quantitative basis for decision ivhen we are faced with an apparent hodge- 
podge of imponderables. A successful military commander is successful be- 
cause he has a wealth -'of experience and training which help him ’’intuit” 
an effective solution from a maze of tactical information. How much more 
effective should military planning become if the ccmmander and his staff 
are provided with a framework of evaluation into which values based on com- 
mand experience can be inserted for complex analyses of their implications! 
Naturally, a mathematical model is not an exact picture of any real situa- 
tion and military planners must practise the use of such tables in peace- 
time exercises in order to work effectively with the new tool previded. 
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APPENDIX 



PROBLEM EXAMPLES 



1, This problem is the same as that stated on the bottom of page 1. 
Notation is the same as that used in Chapter II. 

Let = coal consumed by furnace 

X 2 * coal consvimed by furnace #2. 

100 tons « total coal available initially ^2 ~ • 

f^(x 2 ^) = total steel output from furnace #1 from x^ tons coal. 

” total steel output from furnace #2 from X2 tons coal. 

E(xi,X 2) = -f ^ 2 ^^ 2 ) 



f,(x,) = o :(oiXi<io') 



= 0 



. 1.6 



:(io ^ X/ ^ loo) 



- 10~^^° - -'i) * ) (20 X2 100) 

othenvise . 











fl(xi) 




E(x^^ p ) 


0 






100 


0 


100 


100 (Max) 


20 






iO 


3 


70 


73 


50 






50 


25 


20 


45 


eo 






20 


60 


0 


60 


100 






0 


f5 


0 


<-5 


A plot from 


these values shows 


clearly that 


only furnace nui'iber 2 shouli be 


operated 


in 


this 


example . 








2. This problem 


is the sane as 


tliat stated 


on the bottom of page three ''.d.th 


the same 


assumed 


values as used 


in Probler: 1 


. From tl.e 


values obtained in 



Problem 1, the foUo’.idng table is obtained: 



Strategies — ^ m m 







Bomb to 
facton' #1 


Bomb to 
factory #2 


All coal to 
furnace §\ 




25 


85 


One barge to 
each furnace 




20 


25 


All coal to 
furnace #2 


© 


100 


20 



Table of Possible Occurrences Showing 'Steel Production for Each 
Possible Case. 



To obtain the optimum strategy for the steel executive and for the enemy, 
the following plots are constructed as explained by reference (4). 




These plots show that strategy should be dropped completely, and that 
strategies and (3) should be used as decided by a chance mechanism 
weighted 4/7 to 3/7 and strategies and decided by a mechanism 
weighted 7/l5 to 6/l5. The expected value of steel production for these 
values then would be 5£ units. 
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I 



4 







XOx - y 

y - X 



for (x jC y < 



10^^ /lO 

1+lTlO 



x) 



(24) 



or (x <. y £. flOx) 



and our equations for h and H are: 

1620. c + 1 

^ ~ c+10 • ^ “ C4-10 



(13) & (15) 



Define a set Ila of points from region II such that (x y ^flOx) 
for all points in Ila and such that this relation will hold for no point 
of II which is not in Ila. The above solution is the optimum solution for 
H and h for all values of x and y in Ila for all T. The optimum track for 
a ship which is initially at (x^^y^j) in Ila may be obtained by solving the 
following differential equations 



(""o < yo ^ Vio xq) 



(25) 



(lOx - y) dx -f- (x - y) dy = 0 is of the forms 

M dx4" N dy * 0 and the integrating factor iss 



= 



t yN 



lOx^ - xy xy - y*’ lOx® - y^ 



/^' ■ fio^ - i 



^/lOx 



- 2\JlO 



P I J,. Hdxj = J ^STT7 /55x + y)' 

^ N - Mdxj^ = R(y) - 0 

Solution of (25) is : 

i IndOx* - y^) - In ^ = i ln(10x' - y‘ ) 



X — V 

10x« - y^ 



- ^ In ~ y 

2 \/l0 /IOXq t y, 
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